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ABSTRACT 

The Black Country is a region comprised of four local 
educational agencies (LEAs) in the West Midlands, England. 
School-league table data for the period 1992-94 were collated to form 
a data matrix. Using cluster analysis, 11 types of schools were 
identified. An analysis of electoral ward census data yielded six 
types of localities. Both typologies were combined to form the data 
matrix in order to determine the relationship between location and 
school character i s t i cs . The matrix is a potential method for defining 
the ef f ec t i venes s of s chool “improvement initiatives aga ins t their 
baseline data. The *paper also discusses the potential implications 
for identifying process variables and appropriate school-performance 
indicators, as well as how to accomplish this by comparing 
within-cell and across“cell variations. The method may make possibile 
regional studies within and between European Union member states. Six 
figures and five tables are included. (LMl) 
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' locality Type? anti School Type?V towards Baselines for Irfiprovement 



Presented at the First European Conference on Educational Research, Bath, 14-1 8th September 1995 



The Black Country Is a region comprising four LEAs situated in the West Midlands, England. 
School league table data for the period 1992-1994 was collated to form a data matrix. Using 
cluster analysis, eleven distinct types of schools could be Identified. This was paralleled by an 
analysis of electoral ward census data that yielded six types of locality. The characteristics of 
the school and location typologies are discussed. It Is acknowledged that league table data does 
not capture the mechanics, dynamics, and spirit of each school. However, it was considered 
appropriate to juxtapose both typologies to produce a matrix to determine the relationship 
between location and school characteristics. The matrix provides a potential methodology for 
defining the effectiveness of school Improvement Initiatives, as each school's original co- 
ordinates In the matrix effectively act as a baseline data points. Changes In a school's co- 
ordinates might then be construed as an outcome of school Improvement initiatives. The 
potential Implications for Identifying process variables and appropriate school performance 
Indicators and how this might be achieved by comparing within cell and across cell variations 
are discussed. This exploratory analysis raise the question of regional studies within and 
between European Union member states. 



Key Words: England; Secondary Schools; Urban Localities; Academic Effectiveness 

Introduction 

Rutter, Maughan, Mortimore and Ouston (1979) clearly demonstrated that schools do influence 
academic outcomes. Research into school effects and value added Is ongoing and is becoming 
Increasingly sophisticated in its use of statistical techniques. There has been a move away from the 
analysis of school outcomes by neighbourhood features to Increasingly more student centred 
measures of prior ability, background and attainment on exit. The emphasise is on choosing best 
predictors of exam outcome from which can It be determine whether a school does better (adds 
values) than predicted or worse (subtracts value). This work Is one valuable strand In evaluating 
school outcomes. Our work, whilst taking note of the Importance of deriving reliable and readily 
meaningful Indices of value added. Is currently more concerned with: 



• How do schools vary In performance In a tightly defined regional context? 
Performance can initially be defined In terms of academic outcomes, but must also 
be defined In terms of developing skills and dispositions for active citizenship. 

• How meaningfully can neighbourhoods be grouped in terms of similarity? 

• To what extent does the type of neighbourhood systematically determine the 
parameters of school outcomes? (Conduit, Brooks, Bramley and Fletcher, 1995) 

• The extent to which policy options for education are debated at local level and are 
Informed by the available data. This Includes Issues relating resource usage and the 
effectiveness of targeting. 

• How far can evaluation be concerned with the Intrinsic worth of education? Can this 
be tailored to local and regional requirements? Issue of accountability. 
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• The production of a more refined methodology, which is concerned with the 
significance of process and context and that cuts across discipline boundaries 
(Scheerens, 1990; Climaco, 1992). 

• The management of data at a regional level and participation in its interpretation by 
stakeholders in education. 



Methodology: understanding school performance at a regional level. 

Our methodology treated data relating to neighbourhoods (census data) and schools (league table 
data) as separate entities. No attempt to link census data directly to published school outcome data 
was made, for example. 

Classification of Neighbourhoods 

The following data was collated on the 89 electoral wards^ in the Black Country and was subjected t; 
cluster analysis. 



% Households with no car 
% Households with 2+ Cars 
% Households that own their home / mortgaged 
% Households that privately rent 
% Households that live in local authority housing 
% Households that live in Housing Association 
property 

% Households that are overcrowded 
% European origin 
% Black 

% Indian / Pakistani 
% Other Asian 



% Full-time Male Employment 
% Full-time Female Employment 
% Part-time Male Employment 
% Part-time Female Employment 
Self-employed Males 
% Self-employed Females 
% Males on Govt. Scheme 
% Females on Govt. Scheme 
% Unemployed Males 
% Unemployed Females 
% Economically Active Males 
% Economically Active Females 



This analysis was undertaken using the UPGMA method and yielded six clusters. These six clusters 
were collectively named 'genius loci as they pertain to the special (common or similar) spirits" of the 
localities that they represent. They are relatively stable subject to the addition of new census data. The 
features of six genius loci are summarised in table one. The validity of the clusters was established by: 

i) Inspecting star charts of electoral ward for deviation from common patterns. (Figures one to six 
are star charts of the mean statistics of the six genius loci. They are interpreted by examining each 
co-ordinate in relation to the central ring which represents the Black Country averages. Co- 
ordinates within the ring represents levels below the regional average and the nearer centre they 
are the more significant they can be said to be defining features of the genius locus. Likewise, co- 
ordinates which are furthest from the centre are defining features.) 

II) Discriminate function analysis: It was predicted that a good cluster solution when subjected to 
discriminate function analysis would yield a high reclassification rate. The percentage correctly 
reclassified was 90.70%. In conjunction with visual Inspection of the star charts, some electoral 
wards were reclassified. 



' An electoral ward Is the smallest area of electoral representation In the United Kingdom. 

^ By spihtW Is Implied that a neighbourhood is more than economics, racial composition and buildings. Community spirit Is 
difficult to quantify but has potentially significant effects on school outcomes. 
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FIGURES 1 TO 6; STAR CHARTS REPRESEhfTING DEFINING FEATURES OF THE SIX GENIUS LOO 
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Table 1: Defining Features of Six Genius Loci 







• Above average car ownership - households with 


• Below average car ownership - a quarter more 


2+ cars 40% higher than nationally. 


households than the national average do not have 


• Home ownership a fifth higher than nationally 


a car# 

• Home ownership a fifth lower than nationally 




• Double the national level of Local Authority 




housing 


• Unemployment a third lower than nationally 


• Unemployment two-fifths higher than nationally. 




• Maps onto regional average for full-time male 


• Self-employment matches the national average 


employment 


• Predominately white 


• Predominately white, with Asian populations 




below the regional average. 




• Self-employment two fifths lower than nationally 




• Overcrowding higher than nationally 


Two Incomes White Localities 


^ White (Insecure) Working Males 




Genius LocOs Four 


• Home ownership maps onto the national average 


• Households without a car is 1 .5 times the national 


• Large Asian community (Indian / Pakistani) 


average 


differentiates this cluster from clusters one and two 


• Home ownership averaged 85% the national norm 


# High level of overcrowding 


• Private rented sector is a fifth higher 


• Below regional average for Local Authority 


• Housing association sector three times the national 


housing 


average 


• Full-time male employment below regional 


• Local Authority housing a fifth higher than 


average 


nationally, but below regional norm 


• Full-time female employment above regional 


• Full-time female employment higher than regional 


average 


average 




• Full-time male employment lower than regional 




average. 




• Male unemployment 19.7% 


^ Asian Home Owners 


^Ethnically Mixed, Working Female Localities 






# A single electoral ward 


• Three fifths of households do not a car 


• (Graph distorted) 


• Home ownership Is half the national average 


• Maps on most regional averages for census 


• Private rented sector is a third larger than 


statistics, but approximates national home 


nationally 


ownership levels 


• Double the national level for Local authority 


• Private rented sector two and half times national 


housing 


average 


• Two and half times the level of overcrowding - 


# Can be said to situated between clusteis one and 


highest levels in the region 


two and clusters three, four and six in terms of sizes 


• Half the population is white, A third of Indian / 


of ethnic populations 


Pakistani origin and the remaining being Black. 


• Can be said to be situated between cluster one and 


• Economic activity broadly In line with other 


other clusters In terms of indices of employment 


clusters 


and affluence. 




• High levels of individuals aged 24-44 and 55 plus. 




• High concentration of professional households 




• Population of under 16 a fifth lower than the 




regional average 




Transitional 


•^Highly Deprived, Multiethnic Localities 
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lii) If the genius loci are distinct, then statistical analysis should yield significant differences 
amongst clusters In terms of the attributes used in their definition. This analysis is reported In 
detail by Bramley and Fletcher (mimed). 

iv) It was expected that school outcomes should fall within certain parameters according to the 
genius locus in which they are located or from which they predominately recruit students. 
Schools were assigned to genius loci one to four ( no school was placed in either genius loci 
five and six). Schools were then categorise according to which quartlle their results fell into In 
1994. A total of 74 schools were cross-tabulated (table two)^. A Pearson chi square value of 
25.06 (v=9, p<.01) was obtained. A one-way ANOVA was also performed on the raw data 
(F=8.92, p<.001) and Tukey LSD post hoc tests indicated significant differences In performance 
between genius locus one and genius loci two and three at p<.05 level. 

TABLE TWO: DISTRIBUTION OF EXAMINATION RESULTS BY QUARTILE AND CLUSTER. 





Genius 
Locus 1 


Genius 
Locus 2 


Genius 
Locus 3 


Genius 
Locus 4 


Row Total 


Less than 1 7% 


2 


16 


4 


0 


22 

(29.7%) 


1 7% to 28% 


3 


16 


2 


1 


22 

(29.7%) 


28% to 44.5% 


10 


6 


2 


0 


18 

(24.3%) 


44.5% plus 


8 


2 


1 


1 


12 

(16,2%) 


Column Total 


23 

(31,1%) 


40 

(54.1%) 


9 

(12,2%) 


2 

(2.7%) 


74 

(100%) 



A Pearson chi-square value or 25,06 (OF, 9) was obtained which was significant at the p<.0l level 



4 



The validation strategies cautiously support the existence of genius loci. The use of a single year's 
examination data to validate their effect on school outcomes is sufficient for establishing possible 
parameters of performance based on catchment area. The next stage of the study was the 
Identification of schools with similar patterns of performance and organisation. 



' Independent schools and those with no easily defined catchment area were excluded. 

^ For statistical reasons it may have been appropriate to have collapsed clusters three and four, due to an expected frequency 
of less than In five In some of the cells. 
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Definition of School Types 

Cluster analysis was performed on the 1992 to 1994 league table data. It was felt that three years data 
were realistically the minimum for analysis purposes. This data Includes both examination outcomes 
and organisational data. Some variables were transformed for analysis purposes, for example, 
absences was converted into time in class. 

The following dichotomous variables: 

• Grant Maintained 

• Voluntary 

• Selective 

• Coeducational 

• Sixth form 

• Operates special classes for pupils with educational needs 

The following variables were standardised across the Black Country school data set. 

• Percentage of pupils receiving A to C passes In the years 1 992, 1 993, and 1 994 

• Time-in-dass - calculated by 

(WO- (% authorised^ % unauthorised absence)) x timetabled hours (1994 data) 

• Size of year eleven In years 1 992 to 1 994 

• Percentage of pupils with one or more A to C passes in 19S2 

• Percentage of pupils with five or more A to G passes 

• Percentage of pupils statemented in each school in 1993 and 1994 

• Percentage of pupils gaining vocational qualifications in 1993 and 1994 

Eleven clusters of schools were defined. The eleventh cluster will not be used for analysis purposes as 
it comprises of a single unique case (a Steiner School) and Is therefore easily identified. The features 
are summarised here, but are to be reported elsewhere in greater detail (Bramley, 1995, mtnieo). 

The 1995 data Is to be used to check the robustness of the classification. In subsequent years that 
schools may demonstrate increasing effectiveness by being reclassified. The parameters of the 
classifications are to be held constant for a five year period. 
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TABLE THREE: DEFINING FEATURES OF TEN SCHOOL TYPES 



■ f 1^,5 Schools ■ . 

• Mainly characterised by the fact they are 
Independent. Tendency to exhibit good 
examination results, but not necessarily so. 

' ■ r ' /Near^MaximalFetf^^ 

• Low to mid nineties in terms of 5+ A to C 
passes over the period 1992 to 1994 

• Large Sixth Forms 

• Decline In Statementing 

• High time-in-class 

' / • Middle Perfohners . . 

• Below regional average in terms of five or more 
A to C passes, but distribution cuts across this 
average, performance typically in high 
twenties. 

• Statementing below regional norms, 

• Time-in-class Is above regional norms 



• Almost consistently 1 00% 5+ A to C passes. 

• Sizeable Sixth Forms 

• Statementing below regional average 

• High time-in-class 

;• . ...f CwdFefforme^ * ' v - 

• Results above national and Black Country 
average. 

• Typically no sixth form 

• Statementing typically below regional norms 

• Time-in-class well above regional norms 

• '■ ;/• .'chss^ _ ■ \ 

• In 1992 there was wide dispersion In terms of 
percentage of pupils with 5+ A to C passes 
below the Black Country average. In terms of 
1+ A to C these schools were located between 
the Black Country and national average. 

• In 1993 examination performance was 
moving towards Black Country average, but 
there was no improvement in comparative 
position in 1994. 

• Above average statementing. 

• Above average tlme-in-class 

• Sizeable Sixth Forms 



atlainers : 

• the percentage of pupils obtaining 5+ A to C • 
passes being in the low to mid teens. 

• Average performance in terms of 1+ A to G 

passes, and below the Black Country average in • 
terms of 5+ A to G passes. Dispersion on these • 
indices has increased since 1992. • 

• Schools within this cluster typically do not have 
a sixth form. 

• Statementing has increased from just below to 
above average for the region. 

• Below the regional norm for the time-ln class 
Index 

' ? : ••Mi 

• These schools exhibited in 1992 the lowest • 

percentage of pupils with 5+ A to C passes. This 
cluster still ranked within the bottom three In 
1993; however, in 1994 did better than cluster 
named steady decllners. • 

• having a small sixth form, • 

• above average number of pupils of 
statementing for the Black Country, which is • 
Increasing, 

• below the regional average iime-in-class. 



Performance during the period 1992-94 has 
tended to be in the high teens to low twenties 
in terms of five or more A to C passes 
Sixth forms 

High levels of statementing 

Below regional norms in terms of time-in- 

class. 



■ Steady 

Gradual decline in examination performance 
recorded In 1992 that was In the mid-teens In 
terms of percentage of pupils with five or 
more A to C passes, 
having sixth forms. 

Statementing has increased In these schools 
from being average for the region. 
Time-ln-class Is very low compared with 
other schools in the region. 
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Development of School Effectiveness Matrix 

Secondary schools are assigned respectively to the most appropriate genius loci (locality type) and 
school types. Schools with obviously wide catchment areas, or which extensively recruit outside the 
region were not assigned to a genius locus, whilst other schools are provisionally assigned to a genus 
locus. The additional sources of data (Ofsted Reports, case studies, for example) and direct contact 
with schools are used to refine classification. This classification procedure is essentially iterative in 
nature. School types are defined from their original cluster membership, but in subsequent years 
schools that demonstrate outcomes which are different to their current classification will be 
reassigned. Reassignment is one indication of changes in school effectiveness. 

The two typologies described are cross-tabulated to produce subtypes. This cross-tabulation produces 
the school effectiveness matrix. If school types are ranked in terms of perceived performance and 
genius loci in terms of relatively contextual advantage" then school effectiveness matrix similar to 
below is produced. 

TABLE FOUR: A POSSIBLE DEFINITION OF SCHOOL EFFECTIVENESS 
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N 
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Performance 




N 


N 


IE 


IE 




Low 

contextual 

advantage 




Middle 

contextual 

advantage 




High 

contextual 

advantage 



KEY 

HE Highly effective schools 
E Effective schools 

D Schools that demonstrate that socio-economic situation affects performance 

N Schools that are nor effective. 

I E ineffective schools 



More specifically to the region's data set the following matrix ix produced. 




'Contextual advantage' could be more appropriate concept than 'contextual disadvantage* for comparing schools' contexts. 
Relative advantage goes from least to most whereas relative disadvantage goes from the greatest to an absence of 
disadvantages. All contexts It could be argued have some advantage whilst some contexts have many advantages. 
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TABLE FIVE: A REGIONAL SCHOOL EFFECTIVENESS MATRIX 





Two-Incomes 
white localities 
(A) 


White Insecure 
working male 
(B) 


Aslan Home 
owners 
(C) 


Ethnically mixed working 
female localities 
(D) 
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Large schools with successful 
vocational education 
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Steady Decliners 
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Key 

Highly effective schools 

Those schools where it might be interpreted that "contextual advantage" Influences 
outcomes and might be said to be effective given their context. 

^ Schools that are ineffective 

Increasingly ineffective schools 

There were potentially 66 subtypes^ of secondary schools, but only 23 were exhibited. 



Reservations & Future Directions 

• The validity of defining school effectiveness as being contingent on "contextual advantage". 
Contextual advantage is defined as home, community and economic factors. Each child's 
education Is an unique set of Interactions amongst child's abilities, self-expectations, aspirations, 
motivation and home factors, community factors, economic factors, teacher's expectations, 
opportunities, school organisation and so fourth. The secondary school child has limited control 
over many of these factors and only becomes autonomous in his or her late teens. These 
constraints will influence a child's examination outcomes. 

• The extent to which a community's spirit - genius locus - can be approximated by census data? 
Additional data may be added as It becomes more widely disseminated. Such data might result m 
some localities being differently clustered and / or the emergence of additional clusters. There are 
also the problems of the data becoming increasingly out of date and that data relating to the 10% 
sample (for example, occupational class of head of household) takes longer to become available 
and do so in more plece-meai fashion. 

• The appropriateness of the electoral ward as the unit of analysis. Small area statistics are becoming 
more readily available and this makes more micro-level analysis possible. 
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• To what extent can clusters of localities be ranked In terms of contextual advantage? This process 
is In many respects dependent of value Judgements, but could be anchored to purely economic 
indicators. However, economic indicators do not capture the substance of a neighbourhood 
entirely. 

• The validity of comparing within region school outcomes and converting them into normative 
indexes for the region? The school typology Is based on normalised scores for the regicm and may 
noL be transferable to other regions. 

• The need to define an index of how well each child is prepared for active citizenship. Schools do 
have the responsibility of equipping their students for adult life! This is likely to take the form of a 
composite index and its development requires a greater understanding of how students manage the 
changes from secondary education onwards. 

• The extent to which the school effectiveness matrix can be used to pull non-league table data 
together on the 89 schools in the Black Country for systematic analysis. These data Include press 
reports, Ofsted reports, prospectuses, annual reports, case studies and various other data which is 
not actively organised, for example, undergraduate and masters projects that are school based, 
LEA sponsored school improvement projects and community based projects. 

• The relevance of the data base under construction to practitioners, policy makers and others with a 
stake in the region's education. The development of constructive dialogue in its Interpretation is 
ongoing. 

• Implications with regard to targeting resources / interventions. These interventions can be broader 
than just intervening in the school and include community action and self help. It Is hoped that the 
matrix described here will facilitate the organisation of detailed and often diffuse information in 
such a way that it becomes more manageable for developing educational policies that are 
responsive to localised needs. 
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